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Abstract 

Background: The Expanded Program on Immunization (EPI) in Colombia has made great advances since its 
inception in 1979; however, by 2010 vaccination coverage rates had been declining. In 2010, the EPI commissioned 
a nationwide study on practices on immunization, attitudes and knowledge, perceived service quality, and barriers 
to childhood immunization in order to tailor EPI communication strategies. 

Methods: Colombia's 32 geographical departments were divided into 10 regions. Interviewers from an 
independent polling company administered a survey to 4802 parents and guardians of children aged <5 years in 
these regions. To better assess barriers to vaccination, the study was designed to have 70% of participants who had 
children with incomplete vaccination schedules. Explanatory factorial, principal component, and cluster analyses 
were performed to place participants into a group (segment) representing the primary category of reasons 
respondents offered for not vaccinating their children. Types of barriers were then compared to other variables, 
such as service quality, communication preferences, and parental attitudes on vaccination. 

Results: Although all respondents indicated that vaccines have health benefits, and 4738 (98.7%) possessed 
vaccination cards for their children, attitudes and knowledge were not always favorable to immunization. Six 
groups of immunization barriers were identified: 1) factors related to caregivers (24.4%), 2) vaccinators (19.7%), 3) 
health centers (18.0%), 4) the health system (13.4%), 5) concerns about adverse events (13.1%), and 6) cultural and 
religious beliefs (1 1.4%); groups 1, 5 and 6 together represented almost half (48.9%) of users, indicating problems 
related to the demand for vaccines as the primary barriers to immunization. Differences in demographics, 
communication preferences, and reported service quality were found among participants in the six groups and 
among participants in the 10 regions. Additionally, differences between how participants reported receiving 
information on vaccination and how they believed such information should be communicated were observed. 

Conclusions: Better understanding immunization barriers and the users of the EPI can help tailor communication 
strategies to increase demand for immunization services. Results of the study have been used by Colombia's EPI to 
inform the design of new communication strategies. 
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Background 

The Expanded Program on Immunization (EPI) in 
Colombia operates under the Ministry of Health and 
Social Protection a (MSPS in Spanish) and within the 
General Health and Social Security System (SGSSS in 
Spanish). The country's immunization schedule includes 
nine vaccines: Bacille Calmette-Guerin (BCG); diphtheria, 
pertussis, and tetanus (DPT) vaccine; Hepatitis B; influ- 
enza; measles, mumps, and rubella (MMR) vaccine; oral 
poliovirus vaccine (OPV); pentavalent (DVT -Haemophilus 
influenzae type b or Hib); rotavirus; and yellow fever. 
These vaccines are provided free of charge to all citizens, 
and offer protection against 13 pathogens: Diphtheria, 
Hepatitis B, Hib, influenza, measles, mumps, pertussis, 
poliovirus, rotavirus, rubella, tetanus, tuberculosis, and 
yellow fever. According to a recent external evaluation of 
the program, the EPI has more than tripled its budget 
for vaccine purchases from $32.6 million in 2008 to 
$143 million in 2012 [1]. To reach unvaccinated and 
undervaccinated children, the EPI has conducted vaccin- 
ation days and campaigns, established fixed vaccination 
posts, and sent vaccination brigades to hard-to-reach areas. 

Vaccination coverage rates in Colombia have decreased 
over the last decade. From 2003-2009, administrative cov- 
erage 13 of BCG, third dose of oral polio vaccine (OPV3), 
and third dose of diphtheria, pertussis, and tetanus vaccine 
(DPT3) ranged from 89-97% [2]. By 2011, BCG and OPV3 
coverage rates had fallen to 80.9% and 84.3%, respectively, 
with lower levels reported in many areas [3]. Previous 
studies have linked undervaccination in Colombia to poor 
service quality [4-7], lack of parental knowledge of the 
vaccination schedule [4,7], lack of a regular physician [4], 
low insurance coverage [5,6], inadequate health worker 
knowledge [6], and ineffective communication strategies 
[7]. In addition, inaccurate population estimates (i.e. issues 
related to the denominator) may have affected coverage 
trends [1]. 

A successful communication intervention on immu- 
nization can be defined as an informed, purposeful, and 
repeatable strategy that motivates caregivers to seek or 
continue seeking immunization services for their children 
[8]. Strategies may include radio and television spots, edu- 
cational workshops and sessions, printed materials (flyers, 
banners, posters), and clinical interactions between the 
parent and healthcare professional [8]. Common to all 
strategies is the need for careful research and planning [9]. 
Target populations, means of communication, and the 
content and frequency of messages must be determined 
and weighed against budgetary constraints. In this context, 
differences among users by age group, class, and geo- 
graphic region must be taken into account. Additionally, 
user knowledge, attitudes, and past experiences associated 
with barriers to immunization should be considered in 
developing messages to overcome these barriers [9,10]. 



To better understand immunization barriers in Colombia 
and inform the design of tailored communication strat- 
egies aimed at improving immunization coverage levels, 
the EPI hired an independent polling company to con- 
duct a study on factors inhibiting immunization among 
parents and guardians of children aged <5 years. Infor- 
mation was collected on user demographics, attitudes, 
knowledge, and practices; their perceptions about the 
quality of immunization services; the impact of existing 
communication strategies; and barriers to immunization. 
Based on this information, groups of reasons explaining 
why caregivers do not vaccinate their children were 
identified. Following this study, the EPI developed a 
plan to improve national communication strategies on 
immunization based on the barriers identified as related 
to parents/users. 

Methods 

Sampling 

Participants were required to be adults responsible for 
the vaccination of at least one child aged <5 years. Be- 
cause the study focused on the reasons parents could 
not or choose not to vaccinate their children, the study 
was designed to have approximately 70% of participants 
with children who had incomplete vaccination schedules, 
as corroborated by the interviewers who had been trained 
to assess if the child was up to date with immunization. 
Children with incomplete schedules were defined as those 
lacking at least one vaccine recommended in the national 
schedule for their age. If a participant had multiple chil- 
dren aged <5 years, interviewers collected information on 
all children in order to determine if reasons for undervac- 
cination varied among siblings in the same household. 
Participants were excluded from the study if they failed to 
meet the criteria above or if they worked for a polling or 
public relations company. 

Colombia's 32 geographical departments were divided 
into 10 regions: Antiguos Territorios Nacionales, Antioquia, 
Atlantico, Bogota, Boyaca-Cundinamarca, Eje Cafetero, 
Meta-Arauca-Casanare, Pacifica, Santanderes, and Tolima- 
Huila-Caqueta (Figure 1 and Additional file 1). The polling 
company employed a multi-stage sampling design to select 
participants. The MSPS provided a list of municipalities 
with administrative coverage <75% in each region as well as 
municipal population and vaccination coverage estimates. 
From this list, 3-10 municipalities in each region were 
chosen with probability proportional to the population of 
each municipality and inversely proportional to the cover- 
age reported in that area. A total of 99 municipalities were 
selected. In each municipality, interviewers chose neigh- 
borhoods and blocks at random. Interviewers visited each 
home on the block to reach a quota of homes of children 
aged <5 years with complete (30%) and incomplete (70%) 
vaccination schedules. If the quota could not be completed 
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Region 


Sample 
szie 


Immunization schedule 


Margin of 
error 


Complete 


Incomplete 


% 




100 


31 


69 


8.0 




200 


58 


142 


5.7 


Antioquia 


735 


221 


514 


2.6 


Atlantica 


800 


276 


524 


2.8 


Boyaca- 
Cundinamarca 


605 


164 


441 


3.3 




360 


101 


259 


4.2 




401 


124 


277 


4.0 




601 


182 


419 


3.3 


Santanderes 


500 


146 


354 


3.6 


Tolima-Huila- 
Caqueta 


500 


155 


345 


3.6 


Total 


4.802 


1.458 


3.344 


1.2 



Figure 110 regions of Colombia with sample sizes and margins of error, May 2010. 



from the block initially selected, interviewers moved to 
the next contiguous block. The overall sample had a mar- 
gin of error of 1.2%, while the median margin of error for 
an individual region was 3.6%. 

Implementation 

The surveying team consisted of one national director, sev- 
eral regional directors, approximately 200 interviewers and 
local-level supervisors, and an analytical team composed of 
statisticians, psychologists, and other professionals. To help 
design the study, the company conducted an initial quali- 
tative evaluation, through focus groups, of the reasons that 
Colombians do not or cannot vaccinate their children. 

Interviewers had extensive experience conducting opin- 
ion surveys, and the company had previously implemented 
health surveys. Training sessions were held to educate team 
members on technical topics related to vaccination and to 
show interviewers and supervisors how to read vaccination 
cards. During the sessions, team members reviewed the 
surveying tools to correct potential areas of misunder- 
standing. A pilot project was also held to help interviewers 
gain familiarity with the surveying tools. 

Interviewers administered the questionnaire to partici- 
pants in their homes from 18 May to 9 June 2010. Surveys 
typically lasted 25-35 minutes and were completed on 
weekday afternoons and throughout the day on weekends. 
Participants were guaranteed anonymity and provided 
informed verbal consent. Participants could discontinue 
interviews at any time and received no compensation 
for their time. 

To ensure data quality, supervisors directly observed 
40% of the interviews and reviewed all questionnaires. 
Questionnaires were then sent to regional field offices 



and to a national processing center in Bogota for add- 
itional review. If a problem was detected at any point in 
the process (e.g., incomplete responses), the interviewer 
returned to the participants home to correct the issue. 
Validated data was coded and entered into a Microsoft 
Access database. 

The independent polling company delivered the final 
report of the study to the Ministry of Health five months 
after the study had been officially commissioned. 

Questionnaire 

To better understand the target population, define the 
variables to be measured in the study, design the ques- 
tionnaire, and propose hypotheses on immunization 
barriers for testing in the study's quantitative phase, the 
polling company conducted a pre-study evaluation of 
the intended target population. A total of 186 caregivers 
of incompletely vaccinated children aged <5 years living 
in municipalities with <75% coverage in the selected 10 
regions were convened in focus groups of 10-12 persons. 
Moderators in each group led a conversation on parental, 
structural, cultural, and service-related factors that might 
inhibit immunization (e.g., unfriendly or discriminatory 
service). Discussions lasted approximately two hours. Un- 
like participants in the qualitative study, members of the 
focus groups were compensated for their time. 

Based on input from EPI officials and the information 
gathered from the focus groups, the polling company 
developed a questionnaire for evaluating the causes of 
undervaccination in the country. The EPI reviewed the 
questionnaire to guarantee technical accuracy. The final 
survey contained 76 questions related to demographics; 
parental knowledge, attitudes, and practices on vaccination; 
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user satisfaction; service quality; communication pref- 
erences and practices; and barriers to immunization. In 
Colombia, parents are required by law to present their 
children's complete immunization histories for school 
enrollment [11]. Children with incomplete schedules 
are typically sent to health centers for vaccination; no 
child is denied the right to an education due an incom- 
plete schedule. To measure compliance with the law, 
participants were asked whether they had been required 
to provide their children's immunization histories to kin- 
dergartens or preschools. Participants were also asked two 
questions on appointments for vaccination: 1) whether an 
appointment for vaccination was required (an appoint- 
ment should not be needed) and 2) whether health 
workers wrote the date that the child is next scheduled 
to be immunized on the vaccination card (health workers 
should note the date per EPI guidelines). 

Various question types were used, including recall, di- 
chotomous, open-ended, and multiple response ques- 
tions [12]. Barriers to immunization were assessed with 
level-of-measurement questions in which participants 
ranked various options, and with level-of-agreement 
questions in which participants "agreed", "disagreed", or 
"neither agreed nor disagreed" with a statement concern- 
ing vaccination. An immunization barrier was defined as 
any factor that a caregiver considers to have prevented or 
may in the future prevent a child from being vaccinated. 

Data analysis 

To measure factors inhibiting immunization, the polling 
company performed an exploratory factorial analysis, 
which is a multivariate technique of interdependence to 
explain the correlations between observed variables los- 
ing the least amount of information possible. The princi- 
pal component analysis was used to determine causes 
for the variability of a set of continuous variables and 
rank them by importance. Based on a literature review 
and the results of the qualitative component done using 
focus groups, 30 potential vaccination barrier variables 
were included in the factorial analysis. Variables that had 
eigenvalues greater than one and could explain at least 
60% of the variability were retained for the principal 
component analysis A cluster analysis was used to include 
each individual in a group, such that individuals of the 
same segment were similar to each other and different 
from others, especially on issues related to the reasons for 
non-vaccination, but keeping in mind that some demo- 
graphic variables or topics covered in the questionnaire 
could present similarities between segments. 

Sampling weights were then used to correct for over- 
sampling in some regions, thereby ensuring that the 
number of participants in each segment reflected the 
distribution of the population in Colombia. 



Lastly, the types of barriers were compared with vari- 
ables on demographics, service quality, communication 
preferences, and parental attitudes on vaccination. A per- 
centage for the overall sample was used as a reference 
point to identify each groups salient features (e.g., 33.5% 
of participants in group one live in Atlantico versus 23.1% 
in the overall sample). Significant deviations from overall 
rates are highlighted in the results section of the paper. 
Other statistical analyses were not conducted due to the 
descriptive nature of the study. All data were processed 
and analyzed with version 13 of the Statistical Package for 
the Social Sciences Software (SPSS). 

Ethics 

In Colombia, studies that do not seek to generate 
generalizable knowledge, but rather to answer specific 
questions of public health importance are considered 
"public health operational investigations." As such, they 
are not subject to the IRB review process. However, and 
in order to share these results in a peer reviewed publica- 
tion, the Ethics Committee of the National Institute of 
Health of Colombia, reviewed all the documentation related 
to this manuscript and the study methodology in a meeting 
held on July 11, 2013. The CERN determined that the study 
was exempt from an ethical review. 

Results 

Approximately 50,000 individuals were contacted for 
participation in the study. Of these, approximately 5050 
met the inclusion criteria and 4802 (95.0%) chose to par- 
ticipate. By geographic region, the median study popula- 
tion was 500 participants. Most participants were female 
(96.8%), aged 19-30 years (57.3%), subsidized users of 
the Colombian healthcare system (74.2%), and possessed 
at least a primary level of education (81.6%) (Table 1). 
Twenty-nine percent self-identified as Afro-Colombian 
and 8.6% as indigenous. Participants had a total of 5709 
children aged <5 years. 

Practices 

Of 4802 participants, 4738 (98.7%) possessed vaccination 
cards for their children. As required by the methodology, 
3344 (69.6%) had at least one child with an incomplete 
vaccination schedule and 1610 (48.1%) were unaware 
that their child was undervaccinated (Table 2). 

Overall, 1133 (23.6%) participants reported having for- 
gotten at least one vaccination appointment. Participants 
reported being most likely to forget appointments in 
Antiguos Territorios Nacionales (55.5%) and Pacifica 
(32.4%) and least likely to do so in Eje Cafetero (13.1%) 
and Meta-Arauca-Casanare (9.8%). Nationwide, 2178 
(45.4%) caregivers indicated that they needed an ap- 
pointment to vaccinate their child. The regions where 
most participants said they needed an appointment were 
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Table 1 Characteristics of interviewed persons: Colombia, 
May 2010 



Table 1 Characteristics of interviewed persons: Colombia, 
May 2010 (Continued) 



Characteristic 
Sex of participants 

Male 
Female 
Age (years) 

14-18 
19-25 
26-30 
31-40 
>40 

Relation to child 

Mother 
Father 

Grandparent 

Other family member 

Neighbor 

No response/I don't know 
Education 

Less than primary 

Primary only 

Secondary incomplete 

Secondary complete 

Post-secondary 

No response/I don't know 

Marital Status 

Single 

Married 

Civil union 

Separated/divorced 

Widowed 

No response/I don't know 
Affiliation with health system* 

Subsidized 
Contributor 
Non-affiliated poor 
Other 

No response/I don't know 
Ethnicity 

Indigenous 

Afro-Colombian 

Other 

No response/I don't know 



Participants (n = 4802) No. (%) 

154 (3.2) 
4648 (96.8) 

355 (7.4) 
1558 (32.4) 
1198 (24.9) 
1 1 79 (24.6) 
512 (10.7) 

4217 (87.8) 
149 (3.1) 
328 (6.8) 
95 (2.0) 

9 (0.2) 

4(0.1) 

883 (18.4) 
843 (17.5) 
1194 (24.9) 
1429 (29.7) 
450 (9.4) 
3(0.1) 

1022 (21.3) 
966 (20.1) 
2489 (51.8) 

240 (5.0) 

78 (1.6) 
7 (0.2) 

3561 (74.2) 
1015 (21.1) 

127 (2.6) 

92 (1.9) 
7 (0.2) 

412 (8.6) 
1393 (29.0) 
2957 (61.6) 

40 (0.8) 



Children 

1 

2 
3 

>4 

Age of child in study (n = 5709) 

0- 1 years 

1- 2 years 

2- 3 years 

3- 4 years 

4- 5 years 



3151 (65.6) 
1066 (22.2) 
391 (8.2) 
194 (4.0) 

1179 (20.7) 
1208 (21.1) 
1049 (18.4) 
1114 (19.5) 
1159 (20.3) 



*By law, all Colombians are entitled to health and immunization services. 
Following the reform of the country's health system, citizens are considered 
contributivos (those able to pay for services) or subsidiados (those whose 
receive subsidized care). A small percentage of the population remains 
unaffiliated with the system. 



Antiguos Territorios Nacionales (52.0%), Antioquia 
(58.6%), and Efe Cafetero (64.2%). 

A small percentage of participants (n = 150, 3.1%) indi- 
cated that they once had to pay for vaccines. This finding 
was consistent among regions, except in Antioquia where 
69 (9.4%) caregivers reported once paying for vaccination. 
In most cases (n = 82/150, 54.7%), participants said they 
had to pay for pneumococcal conjugate vaccine (PCV), 
which was not included in the EPI schedule at the time of 
the study. 

Attitudes and knowledge 

All 4802 respondents indicated that vaccines have health 
benefits. However, 819 (17.1%) said that "their parents 
were never vaccinated and never became sick" and 596 
(12.4%) said "that people living in rural areas do not need 
vaccines." Among vaccines in the national schedule, par- 
ticipants recognized the measles-mumps-rubella (MMR) 
and polio vaccines most frequently (57.0% and 53.4%, re- 
spectively) and rotavirus vaccine least frequently (19.0%). 
Residents of Atlantico and Bogota reported greater 
knowledge of vaccines. Residents of Antiguos Territorios 
Nacionales and Tolima-Huila-Caqueta reported less know- 
ledge. Inconsistencies were found between participants' 
self-described and actual knowledge of vaccines: 3077 
(64.1%) claimed to know which disease each vaccine 
prevented, but the average respondent named only four 
diseases. Of the 1725 participants claiming to lack this 
knowledge, 1056 (61.2%) said that health workers failed 
to provide them with clear information. 

Service quality 

A total of 4137 (86.2%) participants considered their last 
visit to a vaccination center "good" or "excellent", 567 



Table 2 Practices, knowledge, and attitudes on vaccination and quality of immunization services, by region: Colombia, May 2010* 



Indicators (agreement with given 
statement) 



Knowledge and attitudes 

I know what disease each vaccine 
prevents 

My parents did NOT become sick 
and they were never vaccinated? 

People living in rural areas do not 
need vaccines^ 

Practices 

I have vaccination cards for all 
my children** 

I was NOT aware that my child 
was lacking one or more vaccines 
(n = 3344)+ 

I need an appointment to 
vaccinate my child* 

I have once had to pay for a vaccine 

I have forgotten at least one 
vaccination appointment 

Service Quality 

During my last visit to a health center, 
immunization services were "excellent" 
or "good" 

Healthcare workers tell me my child's 
next vaccination appointment 00 

Healthcare workers tell me which 
vaccines/boosters my child has received 01 

Healthcare workers inform me of the 
risk of adverse events 00 

During my child's last check-up, a 
physician reviewed my child's 
vaccination card 



Total 

(n = 4802) 
No. (%) 



Region 



Bogota Antiguos Antioquia Atlantico Boyaca- Eje Meta-Arauca- Padfica 

(n = 100) Territorios (n = 735) (n = 800) Cundinamarca Cafetero Casanare (n = 601) 

No. (%) Nacionales No. (%) No. (%) (n = 605) (n = 360) 

No. (%) 



(n = 200) 
No. (%) 



3077(64.1) 87(87.0) 103 (51.5) 464(63.1) 679(84.9) 

819(17.1) 24(24.0) 75 (37.5) 83(11.3) 142(17.8) 

596 (1 2.4) 1 5 (1 5.0) 53 (26.5) 65 (8.8) 90 (1 1 .3) 

4738(98.7) 99(99.0) 197(98.5) 726(98.8) 794(99.3) 

1610 (48.1) 43 (62.3) 89 (62.7) 1 1 1 (21.6) 232 (44.3) 

2178(45.4) 19(19.0) 104(52.0) 431 (58.6) 241(30.1) 



No. (%) 



(n = 401) 
No. (%) 



No. (%) 



150 (3.1) 



3 (3.0) 



3(1.5) 



69(9.4) 10(1.3) 



1133 (23.6) 31 (31.0) 111 (55.5) 102(13.9) 232 (29.0) 



363 (60.0) 
83 (13.7) 
69 (11.4) 

601 (99.3) 
251 (56.9) 

235 (29.4) 

18 (3.0) 
182 (30.1) 



249 (69.2) 256 (63.8) 
77(21.4) 34(8.5) 



49 (13.6) 



29 (7.2) 



358 (59.6) 
190 (31.6) 
145 (24.1) 



Santanderes Tolima-Huila- 
(n = 500) Caqueta 
No. (%) (n = 500) 

No. (%) 



296 (59.2) 222 (44.4) 
54(10.8) 57(11.4) 



53 (10.6) 



360(100.0) 400(99.8) 586(97.5) 



128 (49.4) 



184 (66.4) 275 (65.6) 



231 (64.2) 143 (35.7) 



290 (48.3) 248 (49.6) 



2 (0.6) 
47 (13.1) 



8 (2.0) 
39 (9.7) 



13 (2.2) 
195 (32.4) 



14(2.8) 
100 (20.0) 



441 5 (91 .9) 90 (90.0) 1 87 (93.5) 715 (97.3) 725 (90.6) 548 (90.6) 354 (98.4) 

3733 (77.7) 88 (88.0) 138 (69.0) 635 (86.4) 655 (81.9) 51 1 (84.5) 292 (81.1) 

4283(89.2) 92(92.0) 160 (80.0) 697(94.8) 712(89.0) 564(93.2) 343(95.3) 

3807 (79.3) 86 (86.0) 152 (76.0) 677 (92.1) 686 (85.8) 514 (85.0) 317 (88.1) 



28 (5.6) 



493 (98.6) 482 (96.4) 
175 (49.4) 122 (35.4) 



236 (47.2) 

10 (2.0) 
94 (18.8) 



4137(86.2) 94(94.0) 169(84.5) 710(96.6) 633(79.1) 558(92.2) 327(90.8) 369(92.0) 437 (72.7) 421(84.2) 419(83.8) 



378(94.3) 531(88.3) 428 (85.6) 459(91.8) 

304 (75.8) 471 (78.4) 338 (67.6) 301 (60.2) 

358 (89.3) 517 (86.0) 372 (74.4) 468 (93.6) 

302(75.3) 369 (61.4) 307 (61.4) 397(79.4) 



Table 2 Practices, knowledge, and attitudes on vaccination and quality of immunization services, by region: Colombia, May 2010* (Continued) 

I had to present my child's vaccination 2930(61.0) 61(61.0) 89 (44.5) 409(55.6) 630(78.8) 379(62.6) 240(66.7) 171 (42.6) 330(54.9) 364(72.8) 257 (51.4) 
card as a prerequisite for her entry into 
preschool or kindergarten 

*Values in this table reflect participant responses in each of the 10 regions evaluated. Bold values reflect deviations from rate in overall study population (difference of >8 points). 
^Participants were required to provide interviewers with a copy of the child's vaccination card. 

+Total include only those participants with at least one child with an incomplete immunization schedule (n = 3344). Percentages based on regional totals of children with incomplete schedules: Bogota (69), Antiguos 
Territorios Nacionales (142), Antioquia (514), Atlanta (524), Boyaca-Cundinamarca (441), Eje Cafetero (259), Meta-Arauca-Casanare (277), Pacifica (419), Santanderes (354), and Tolima-Huila-Caqueta (345). 
♦For the purposes of this table, totals include respondents who indicated they agreed with statement given. Participants who "neither agreed nor disagreed," "disagreed," or chose not to respond were excluded. 
°°For the purposes of this table, totals include respondents who indicated that event occurred "always" or "almost always." Participants who indicated event occurred "sometimes," "rarely," or "never" were excluded. 
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(11.8%) considered it "average", and 94 (2.0%) considered 
it"bad" or "very bad." Nationwide, 4415 (91.9%) partici- 
pants reported receiving a "next vaccination" appoint- 
ment, 3733 (77.7%) reported being told which vaccine 
their child had received, and 4283 (89.2%) reported be- 
ing informed of the possibility of adverse reactions. 

Service quality varied by region, with poorest service 
reported in Antiguos Territorios Nacionales, Pacifica, 
Santanderes, and Tolima-Huila-Caqueta. When partici- 
pants were asked whether they had to present proof of 
their child's immunization status for school enrollment, 
2930 (61.0%) said "yes." Participants reported that a 
greater proportion of nurses (n = 4438, 92.4%) than physi- 
cians (n = 3807, 79.3%) reviewed their child's vaccination 
card during the last wellness visit, and 3442 (71.7%) partic- 
ipants reported that they had been asked for the card 
when visiting a health facility for a purpose other than 
vaccination. Lastly, 2228 (46.4%) indicated they had re- 
cently faced circumstances making vaccination difficult 
or impossible. Such circumstances included distance 
from health centers (n = 809), lack of vaccines (n = 591), 
limited days/hours of operation (n = 423), and refusal of 
healthcare personnel to open a vaccine vial for one child 
(n = 390). 



Communication strategies 

Participants believed that hospitals (54.1%), the municipal 
government (34.2%), and the departmental government 
(33.4%) were responsible for publicizing immunization. 
The three most common ways parents reported receiving 
information on immunization were television (38.0%), vac- 
cination days/campaigns (33.2%), and conversations with 
health workers during pediatric wellness visits (31.4%). 
Television was reported as the primary means of com- 
munication in three regions (Atlantico, Bogota, Boyaca- 
Cundinamarca), pediatric wellness visits in three (Antioquia, 
Pacifica, Santanderes), vaccination days/campaigns in 
two (Eje Cafetero, Meta-Arauca-Casanare), radio in one 
(Antiguos Territorios Nacionales), and mobile loud- 
speakers on cars in one (Tolima-Huila-Caqueta). In 
comparing these responses to answers on the best ways 
to publicize immunization, differences were observed 
at the regional and national levels. Figure 2 shows that 
1740 (36.2%) participants considered radio a preferable 
means of communication, while only 1257 (26.2%) indi- 
cated they had received information by radio. Similarly, 
396 (8.2%) reported learning of immunization through 
mobile loudspeakers, but only 204 (4.2%) considered 
loudspeakers a valuable means of communication. Overall, 
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Figure 2 Means of communication, practices versus best means as identified by participants: Colombia, May 2010* *. Participants were 
able to identify multiple ways that they had received information on immunization as well as multiple ways that they believed were the best 
means for receiving such information. 
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only four respondents chose the Internet as their preferred 
means of receiving information on vaccination. 

Participants were asked to evaluate the efficacy of 
current communication efforts. A total of 3335 (69.5%) 
participants agreed with the statement, "Messages exist 
that motivate parents to vaccinate their children", while 
3474 (72.3%) agreed that "Hospitals adequately inform 
parents of vaccination days/campaigns" and 3617 (75.3%) 
agreed that "Workshops are needed to raise awareness of 
fathers concerning the importance of vaccination." When 
asked how to improve parents' motivation to vaccinate, 
1847 (38.5%) participants suggested that community-level 
educational sessions on immunization be held. Other sug- 
gestions included "nothing" (n = 736, 15.3%), "improved 
service quality in health centers (n = 510, 10.6%), "better 
vaccine coverages" (n = 433, 9.0%), and "vaccination visits 
in homes" (n = 403, 8.4%). 

Immunization barriers 

The 3344 participants with at least one undervaccinated 
child offered various explanations for their children's in- 
complete schedules. These included "the parent not paying 
attention to the dates on the vaccination card" (n = 1595, 
47.7%), "lack of vaccines in health centers" (n = 643, 19.2%), 
"parental negligence" (n = 365, 10.9%), "expense of vac- 
cines" (n = 360, 10.8%), "lack of time" (n = 247, 7.4%), "the 
child's illness following a previous vaccination" (n = 168, 
7.5%), and "the child's lack of affiliation with the health sys- 
tem (n = 90, 2.7%). Using the multivariate factorial tech- 
niques, six groups of participants who identified different 
types of immunization barriers were determined. Charac- 
teristics for each group are presented below, with values 
given in reference to percentages from the overall sample. 

Group 1: caregivers who identified barriers related to the 
parent/guardian (24.4%, n = 1172) 

Participants in this group primarily identified problems 
associated with themselves, such as lack of time (68.6% 
vs. 29.7%) and long lines in health centers (62.1% vs. 
42.0%), as potential immunization barriers (Table 3). In- 
deed, 17.8% of group one caregivers attributed their child's 
incomplete immunization schedule to parental negligence 
(overall 12.6%), while 12.3% attributed it to lack of time 
(overall 8.4%). More respondents in this group reported 
living far from health centers (26.1% vs. 19.5%) and fewer 
said that immunization services were "excellent" or "good" 
(79.7% vs. 85.5%). 

Group one members resided in Atlantico (33.5% vs. 
23.1%) and Santanderes (13.9% vs. 7.7%) and were subsi- 
dized users of the healthcare system (77.8% vs. 72.6%). 
Regarding means of communication, group one mem- 
bers preferred television (58.0% vs. 51.1%) and believed 
that talks/workshops in health centers would improve 
the public's knowledge of vaccination (26.2% vs. 22.4%). 



Group 2: caregivers who identified barriers related to the 
vaccinator (19.7%, n = 946) 

Nearly twenty percent of participants associated immu- 
nization barriers primarily with the vaccinator. These 
included the vaccinator's unwillingness to immunize the 
child due to a cold (56.9% vs. 16.5%) or fever (55.2% vs. 
13.4%), fear of administering multiple vaccines at once 
(13.4% vs. 2.6%), and refusal to immunize a child who 
lacked a vaccination card (11.2% vs. 5.7%). 

Group two members lived predominantly in Bogota 
(20.6% vs. 15.6%) and Pacifica (19.1% vs. 16.3%). Forty-six 
percent were Afro- Colombian (overall 35.0%). 

Group 3: caregivers who identified barriers related to health 
centers (18.0%, n = 866) 

Group three members cited vaccine stockouts (65.4% vs. 
28.1%), the unfriendliness of health workers (38.7% vs. 
13.3%), and the vaccinator's refusal to open a single vial 
of vaccine for a child (53.2% vs. 16.2%) as immunization 
barriers. Consistent with these findings, more group three 
members attributed their children's incomplete schedules 
to vaccine stockouts (20.4% vs. 18.6%) and more reported 
that they had been denied service because the vaccinator 
would not open a vaccine vial without multiple children 
present (13.1% vs. 6.9%) 

Group three members disproportionately resided in 
Tolima-Huila-Caqueta (16.6% vs. 6.8%). To improve 
awareness of immunization, members of this group in- 
dicated that loudspeakers were a valuable means of 
communication (8.0% vs. 3.2%) and that improved ser- 
vice in health centers would increase the population's 
motivation to vaccinate (16.4% vs. 10.4%). 

Group 4: caregivers who identified barriers related to the 
health system (13.4%, n = 642) 

Group four participants cited immunization barriers re- 
lated to a lack of affiliation with the health system (66.1% 
vs. 13.8%), distance from the vaccination site (49.7% vs. 
33.4%), lack of a vaccination card (65.5% vs. 14.6%), and 
the cost of vaccines (24.9% vs. 14.4%). In addition, 57.5% 
indicated that they could not vaccinate their child without 
an appointment (overall 40.5%). A greater proportion also 
did not possess vaccination cards (1.7% vs. 1.3%). 

Group four members lived in Pacifica (23.9% vs. 16.3%), 
Antioquia (20.9% vs. 12.8%), and Eje Cafetero (17.6% vs. 
5.0%). Elevated proportions of this group were Afro- 
Colombian (41.7% vs. 35.0%) and indigenous (10.3% vs. 
6.8%). Group four participants preferred educational 
sessions to be held in hospitals (48.9% vs. 37.3%) and 
communication activities conducted through vaccination 
days/campaigns (39.8% vs. 31.4%). Twenty-five percent 
indicated that public's knowledge of vaccination could 
be improved by raising awareness of the importance of 
vaccines (overall 17.8%). 
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Table 3 Immunization barriers, communication preferences, and service quality, according to six groups of caregivers 
identifying distinct types of immunization barriers: Colombia, May 2010* 

Indicators (agreement with given statement) Total Group 7 Group 2 Group 3 Group 4 Group 5 Group 6 

(n=1,172) (n = 946) (n = 866) (n = 642) (n = 628) (n = 548) 

% % % % % % 

Group 7: Caregivers identifying barriers associated with parents or 
caregivers 

One reason that parents do not vaccinate their children are long lines at 42.0 62.1 31.8 56.2 23.1 23.7 37.6 
health centers 

One reason that parents do not vaccinate their children is lack of time 29.7 68.6 20.1 6.7 30.8 11.6 19.0 

My child has an incomplete schedule or has never been vaccinated 8.4 12.3 6.5 6.4 8.5 11.4 3.8 

because I lack the time 

My child has an incomplete schedule or has never been vaccinated due to 12.6 17.8 9.5 9.4 14.3 11.5 11.8 
my negligence (or the negligence of the parents) 

I have forgotten at least one vaccination appointment 25.5 31.1 25.5 21.0 24.1 22.4 26.0 
Group 2: Caregivers identifying barriers associated with vaccinators 

One reason that parents do not vaccinate their children is the vaccinator's 2.6 0.0 13.4 0.0 0.0 0.0 0.0 

fear of administering multiple vaccines 

One reason that parents do not vaccinate their children is because the 5.7 3.3 11.2 1.4 10.0 5.1 3.4 
vaccinator said the child cannot be immunized if the parent has not 
brought the child's vaccination card 

One reason that parents do not vaccinate their children is because the 16.5 4.2 56.9 5.7 6.0 7.3 13.4 

vaccinator says the child has the flu and thus cannot be vaccinated 

One reason that parents do not vaccinate their children is because the 13.4 2.1 55.2 2.8 2.8 3.6 6.0 

vaccinator says the child has a fever and thus cannot be vaccinated 

During my last visit to a health center, the physician reviewed my child's 79.9 82.4 80.4 81.1 71.1 79.6 82.7 
vaccination card 

Group 3: Caregivers identifying barriers associated with the hospital or 
health center 

One reason that parents cannot vaccinate their children is the refusal of 16.2 5.4 11.5 53.2 8.6 9.1 5.5 

health workers to open a vaccine vial without a sufficient number of 

children 

One reason that parents cannot vaccinate their children is because there 28.1 22.3 24.6 65.4 11.1 22.0 14.6 
are no vaccines available when they take their children to be immunized 

One reason that parents do not vaccinate their children is because 13.3 5.0 8.8 38.7 7.4 9.2 10.5 

healthcare professionals are unfriendly 

During my last to a health center, I was unable to vaccinate my child 6.9 5.9 5.7 13.1 3.4 6.7 5.2 

because health workers were unwilling to open a vaccine vial for my child 
due to the lack of a sufficient number of children 

My child has an incomplete schedule or has never been vaccinated 18.6 22.4 15.2 20.4 11.5 24.2 15.5 
because when I took him to be immunized, no vaccines were available* 

Group 4: Caregivers identifying barriers associated with the health care 
system 

One reason that parents do not vaccinate their children is the lack of a 14.6 6.4 7.5 3.2 65.5 9.5 8.4 
vaccination card 

One reason that parents cannot or do not vaccinate their children is the 13.8 3.1 7.1 4.4 66.1 7.4 8.8 

lack of association with the healthcare system (unaffiliated status) 

One reason that parents cannot or do not vaccinate their children is 33.4 44.1 15.9 32.9 49.7 26.2 30.4 
because the vaccination center is far away 

One reason that parents do not vaccinate their children is that they have 14.4 7.3 12.3 19.4 24.9 11.0 17.2 
to pay for the vaccines 

During my last attempt to vaccinate my child, I had to travel far to a 19.5 26.1 19.1 14.6 18.0 17.7 17.2 
health center 

Not everyone has access to vaccination services* 7.7 6.3 7.2 7.6 9.8 7.3 9.4 
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Table 3 Immunization barriers, communication preferences, and service quality, according to six groups of caregivers 
identifying distinct types of immunization barriers: Colombia, May 2010* (Continued) 



Group 5: Caregivers identifying barriers associated with adverse events 

One reason that parents do not vaccinate their children is because the 
children become sick following vaccination 

One reason that parents do not vaccinate their children is because the 
husband does not like the children to become sick following vaccination 

One reason that parents do not vaccinate their children is because they 
fear giving the child multiple vaccines at once 

My child has an incomplete vaccination schedule or has never been 
vaccinated because she became sick the last time she was vaccinated 

Group 6: Caregivers identifying barriers associated with religious and 
cultural beliefs 

One reason that parents do not vaccinate their children is because the 
family does not agree with vaccination 

One reason that parents do not vaccinate their children is because people 
living in rural areas do not need vaccines 

One reason that parents do not vaccinate their children is because they 
have religious and/or cultural beliefs that impede vaccination 

My parents were never vaccinated and they never became sick+ 

People in rural areas do not vaccines* 

Communication indicators 

Television is the one of the best ways to raise awareness about vaccination 

Talks/workshops in hospitals are one of the best ways to raise awareness 
about vaccination 

Fliers are one of the best ways to raise awareness about vaccination 

The public's knowledge of vaccination can be improved with more 
information and by training the community 

The public's knowledge of vaccination can be improved by holding talks/ 
workshops in healthcare establishments 

The public's knowledge of vaccination can be improved by raising 
awareness of the importance of vaccines 

Service indicators 

During my last visit to a health center, immunization services were 
"excellent" or "good" 

Healthcare workers tell me my child's next vaccination appointment 00 

Healthcare workers tell me which vaccines/boosters my child has received 00 

I need an appointment to vaccinate my child+ 

All patients are treated equally in health centers* 

Children receive the same service regardless of where they are from+ 
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*As described in the methodology, the final step of our factor analysis involved corrected for the oversampling of some regions using sampling weights. 
Percentages provided in this table reflect these adjustments. Bold values for each group represent significant deviations from rates in the overall sample 
presented in the second column. 

+For the purposes of this table, totals include respondents who indicated they agreed with statement given. Participants who "neither agreed nor disagreed," 
"disagreed," or chose not to respond were excluded. 

°°For the purposes of this table, totals include respondents who indicated that event occurred "always" or "almost always." Respondents who indicated event 
occurred "sometimes", "rarely," or "never" were excluded. 



Group 5: Caregivers who identified barriers related to 
adverse events (13.1%, n = 628) 

Members of this group identified barriers related to the 
child's sickness following immunization (53.5% vs. 22.5%), 
the husbands unwillingness to vaccinate the child due to 
potential adverse reactions (35.0% vs. 9.1%), and the fear 



of a child receiving multiple vaccines at once (47.8% vs. 
9.7%). More group five members reported that their 
children experienced mild adverse events following vac- 
cination, such as fever (85.3% vs. 81.2%), persistent cry- 
ing (43.4% vs. 36.3%), and swelling at the injection site 
(28.6% vs. 22.4%). 
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Participants in this group lived in Atlantico (25.2% vs. 
23.1%), Bogota (20.3% vs. 15.6%), and Antioquia (16.2% 
vs. 12.8%). The groups participants were more likely to 
believe that vaccination should be publicized through 
flyers (32.4% vs. 25.4%) and posters (19.5% vs. 15.7%). 

Group 6: caregivers who identified barriers related to 
society and culture (11.4%, n = 548) 

Participants in this group said that "religious and cul- 
tural beliefs might impede vaccination" (37.4% vs. 5.9%) 
and that "one reason that people do not vaccinate their 
children is the belief that people in rural areas do not 
need vaccines" (37.2% vs. 5.6%). 

Factors correlated with societal and cultural barriers to 
immunization include being aged 14-18 years (9.7% vs. 
6.7%) and possessing less than a primary education (20.9% 
vs. 16.8%). Group six participants lived predominantly in 
Atlantico (19.3%), Bogota (19.2%), and Antioquia (14.1%) 
in proportions roughly equal to those in the overall study 
population. More group six members suggested that better 
training activities would improve the public's knowledge 
of vaccination (26.9% vs. 23.8%). 

Groups one, five, and six represented a 48.9% of the 
users interviewed and were used to inform the design of 
Colombia's new immunization communication strategies. 

Discussion 

This study was instrumental in better understanding par- 
ental practices, attitudes and knowledge, perceived service 
quality, and preferences for communication strategies in 
Colombia. The study also helped characterize barriers to 
immunization, showing that nearly half of the parents and 
guardians in this study were not adequately demanding 
vaccination services. Overall, 24.4% of participants primar- 
ily associated reasons related to themselves (group one) as 
immunization barriers, while 24.5% cited adverse events 
and religious/cultural beliefs (groups five and six). These 
findings reinforce the notion that re-designed and im- 
proved communication strategies on immunization were 
needed in Colombia to generate increased demand for 
immunization. Additionally, associations among the types 
of barriers were observed, including associations between 
service quality and parental factors, such as forgotten ap- 
pointments. In this respect, our findings are consistent 
with a recent assessment of 202 studies on the epidemi- 
ology of unvaccinated and undervaccinated children in 
low- and middle-income countries that found factors 
associated with undervaccination to be complex and 
interrelated [13]. 

While this study is the most comprehensive investiga- 
tion on undervaccination ever conducted in Colombia, 
conclusions on coverage rates or the overall quality of the 
EPI cannot be drawn, since 70% of participants of the 
study were required to have undervaccinated children. 



Additionally, attributing non-vaccination or undervaccina- 
tion to a single cause risks oversimplification [13,14]. For 
this reason, multivariate analytical techniques were used 
to categorize participants according to groups of related 
reasons. A participant may belong to one group, while 
being influenced by factors in other groups. However, we 
recognize that the potential overlap among groups risks 
confusing reasons for under-vaccination. This is particu- 
larly true in situations in which a participant may have 
chosen to attribute a child's undervaccination to the 
healthcare system rather than to his own actions. For 
example, a parent who did not obtain a vaccination card 
for her child may have attributed her child's vaccination 
status solely to a health center's refusal to vaccinate her 
child due to lack of a vaccination card. A final set of 
limitations relates to participant responses. Recall and 
reporting biases may have affected responses to questions 
on service quality and attitudes favoring vaccination. In 
addition, since the multivariable analysis was based on 
participant beliefs concerning the reasons that "people" do 
not vaccinate their children, these responses do not neces- 
sarily reflect participants' own reasons for not vaccinating 
their children. 

Despite these limitations, this study provides valuable 
insights on declining immunization coverage rates in 
Colombia. Most significantly, caregivers may now be 
less motivated to vaccinate their children. Indeed, while 
48.9% of participants identified immunization barriers 
related to the demand of vaccines as the primary obsta- 
cles to immunization, these factors may play a larger 
role among caregivers with undervaccinated children. 
Of the 3344 caregivers studied who had at least one 
undervaccinated child, 2177 (65.1%) attributed their child's 
incomplete schedule to parental negligence, lack of time, 
or not paying attention to the dates on the vaccination 
card— all problems related to the demand for rather 
than the supply of vaccines. Ironically, the success of 
Colombia's immunization program in eliminating or sig- 
nificantly reducing the incidence of vaccine-preventable 
diseases may have contributed to the public's perception that 
immunization is now less important. This phenomenon, 
in which immunization programs become victims of their 
own success, has been observed in other countries [9]. 

To increase user motivation, new communication strat- 
egies should appeal to the emotions of caregivers, empha- 
sizing that vaccine-preventable diseases still pose serious 
threats to their children's wellbeing, while addressing com- 
mon misperceptions about immunization. To this end, 
four basic messages for caregivers have been identified. 
First, children are not fully vaccinated unless they have re- 
ceived all doses of all required vaccines. Second, parents 
must bring vaccination cards to health centers regardless 
of the purpose of the visit so that health workers may re- 
view the card. Third, vaccination is a shared responsibility 
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between parents and health workers— and parents should 
be active participants in the process. If more parents de- 
mand that health workers review the vaccination card, 
fewer children will leave health centers with incomplete 
schedules. Lastly, in light of the participants who identi- 
fied cost as a barrier, the EPI should remind users that 
all vaccines in the national schedule are free for citizens. 
While the number of parents attributing their children's 
incomplete schedules to vaccine cost was likely elevated 
because the study was conducted at a time in which 
PCV was not yet included in the national schedule, re- 
minders emphasizing vaccination as a free public good 
may increase the population's motivation to vaccinate. 

Another important contribution from this study is the 
ability to better tailor the EPI communication strategies 
to the wide differences among immunization services 
users (audience segmentation). For example, messages can 
remind those individuals who identify lack of affiliation 
with the health system as a barrier that neither affiliation, 
nor the possession of a vaccination card, nor registration 
in Colombia's civil registry are requirements for vaccin- 
ation. Alternatively, the EPI may design strategies to 
prioritize vulnerable regions identified in this and previ- 
ous studies [15]. These regions might include Antiguos 
Territorios Nacionales, Pacifica, Santanderes, and Tolima- 
Huila, where some service-quality indicators were found 
to be more than 20 points below national averages. 

Attention should also be paid to minority populations. 
Elevated proportions of Afro-Colombians and indigenous 
citizens identified barriers related to the vaccinator and 
health system, and only 72.1% participants believed that 
people in health centers were treated equally regardless of 
their affiliation with the healthcare system. These findings 
are consistent with previous studies in Colombia [5,6]. 
Another potential target group is fathers. While mothers 
generally take children to be vaccinated, fathers often 
influence the decision to vaccinate. Participants in all 
six groups indicated that workshops should be held to 
educate fathers on the importance of vaccination. 

In addition to the need for tailored interventions, several 
interventions applicable to all regions and respondent 
groups were identified. Foremost among these is the po- 
tential use of educational sessions to reinforce the four 
aforementioned messages; 38.5% of participants indicated 
that such sessions were the best means to raise awareness 
of vaccination. Ideally, healthcare or public health profes- 
sionals would lead these sessions in collaboration with 
community leaders [9]. To complement these efforts, 
the EPI should seek to improve communication efforts 
in health centers. Though evidence on the impact of face- 
to-face interventions for informing caregivers about 
childhood vaccination is mixed, some studies have sug- 
gested that successful interactions between parents and 
healthcare professionals encourage caregivers to return for 



immunizations in the future [16,17]. Communication 
interventions in Colombia should thus work to improve 
health workers' ability to establish a rapport with parents, 
understand and address their concerns, and comply with 
basic standards of care. It is recommended that the EPI 
conduct training and supervision activities to teach vac- 
cinators to be better advocates for immunization and 
prepare them to administer vaccines properly and ac- 
cording to national policy (e.g., opening a vaccine vial 
for a single child is acceptable). Checklists may help to 
ensure that health workers provide caregivers with in- 
formation on the vaccines administered, what to do if a 
reaction occurs, and when to return to receive the next 
vaccination dose [18,19]. 

Lessons learned 

The EPI benefited from outsourcing this study to a pro- 
fessional polling company. The company provided an in- 
dependent perspective on the country's challenges and 
expertise in conducting national health surveys. The quali- 
tative phase of this study was critical. By convening focus 
groups of parents of undervaccinated children, the EPI 
and polling company refined research questions, became 
aware of important local circumstances, and ensured that 
the language and content of the surveying tools were ap- 
propriate. Results of the qualitative phase complemented 
the quantitative study, providing health officials with use- 
ful descriptive data. 

Conclusion 

The EPI of Colombia conducted a large study on paren- 
tal practices on immunization, attitudes and knowledge, 
perceived service quality, and barriers to immunization. 
One component of successful immunization programs 
is the use of communication strategies to address immu- 
nization barriers related to parental circumstances (e.g., 
lack of time), concerns about adverse events, and religious 
and cultural beliefs. In this study, almost half of users 
identified such inhibitors as the primary barriers to 
immunization. Tailored communication strategies in- 
formed by this study are being implemented by Colombia's 
EPI. Similar studies in the future can help assess the 
usefulness of these communication strategies in increas- 
ing demand for immunization services. 

Endnotes 

a At the time of the study, the MSPS (Ministerio de Salud y 
Proteccion Social) was named the MPS (Ministerio de 
Proteccion Social). The current name, MSPS, is used 
throughout this article. 

Administrative coverage is obtained by dividing the 
number of doses administered to the target population 
by the estimated target population. 
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study, Colombia, 2010. 
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